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Experiments were carried out with verbal behavior which are 
extensions and adaptations of general laboratory principles developed 
with animals. The experiments have been In three areas. The first 
was an application of general principles of verbal behavior, largely 
based on Skinner's analysis of verbal behavior, to the problems of 
teaching a second language. Actual teaching programs were developed 
In German and Vietnamese. 

The second area of research was a program of experiments designed 
to test the hypothesis that training as a listener and a reader would 
enhance the development of speaking and writing. The experiments 
were carried out, using a single Vietnamese phoneme, to trace the 
Influence on pronunciation of the subject's skill as a listener. 

A third class of experiments concerned motivational variables. The 
aut::/ii>atlc programming of the teaching machine materials made It 
possible to manipulate many of the relevant relnforcers. The exper- 
iments dealt particularly with the aspect of the teaching machine 
performances that was reinforced. In some experiments reinforce- 
ment occurred at the end of the session when the student demonstrated 
the new performance In the second language. In other experiments 
the reinforcement occurred card by card as the student went through 
the program, etc 

7. Key Words: 
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The Psvchoblo logical Invest ligation 



of the Development of New Verbal Behavior 

EKperlments were carried out with verbal behavior which are 
extensions and adaptations of general laboratory principles developed 
with animals* The experiments have been In three areas. 

Second Language Teaching Programs 

The first was an application of general principles of verbal 
behavior largely based upon Skinner’s analyses of verbal behavior 
to the problems of teaching a second language. The teaching pro- 
gram, previously developed by the principal Investigator In the 
German language, was refined and extended. A field trial was 
carried out In German using college students. The results of this 
experiment are reported In the article attached entitled, "An Exper- 
iment In Teaching a Second Language." This article describes the 
techniques of Instruction embodied In the program and the general 
principles which were applied. The article Is In press In IRAL. 

A teaching program In Vietnamese was also developed and tested. 

The Vietnamese program was designed as a tool for the study of the 
general motivational variables Involved In learning the languages 
and hence was not so developed as the German. The Vietnamese pro- 
gram, however, showed the possibility of extending the general plan 
of the German materials to other languages, even as disparate as 



Vietnamese 
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The Speaker and Listener In the Same Skin 

The second area was a program of experiments designed to 
test the hypothesis that training as a listener and a reader 
would enhance the development of speaking and writing. We reasoned 
that If the student became a skilled listener under the control of 
fine details In nuance of the spoken and written language the 
effects of his speech on himself would differentially reinforce 
his own vocal productions. We, therefore, carried out a series 
of experiments with a restricted sanq>le of Vietnamese sounds. The 
student was trained to listen to the sound and differential rein- 
forcement was applied In terms of his ability to distinguish be- 
tween appropriate and Inappropriate designation of the Vietnamese 
phoneme. His pronunciation, however, was never corrected. As we 
tested his ability to pronounce the phoneme periodically as be 
underwent training as a listener we could measure the extent to 
which his training In listening and reading provided the appropriate 
differential reinforcement for speaking and writing. 

Schedules of Reinforcement and Other Matlvatlonal Variables 

A third class of experiments concerned motivational variables. 
The automatic programming of the teaching machine materials made It 
possible to manipulate many of the relevant relnforcers explicitly. 
Bor example, there Is a hierarchy of relnforcers beginning with 
the tone which occurs when the student pushes the correct button. 
Then there Is a coin, a counter Indication or a spoken delivery 
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whlch can occur every so many times the student completes a card 
correctly. For exanple, the student is paid 25 cents for each 
counter indication, and the counter advances one for each 15 suc- 
cessively correct cards which the student completes. Then follow- 
ing the lesson the student may Interact with the Instructor in 
such a way that he is given an opportunity to exhibit the new 
behaviors he has acquired. in the preceding lesson. This inter- 
action differentially reinforces the preceding behavior to the ex- 
tent that the student finds progress in the language rewarding. 
Further contingencies were arranged by paying the stisdent in terms 
of his progress rather than by the card. Under this condition 
Instead of receiving so many cents for a certain number of success- 
fully con^leted items the student is paid when he exhibits the re- 
quired repertoire to the Instructor. An additional variable in 
these areas is the actual schedules of reinforcement which because 
of the machine operation and explicit design of the procedures can 
be manipulated much as in the classical animal experiment. 
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ProgramDoed Instruction in German and Vietnamese 




German 

The following article In press In the International Review 
of Applied Linguistics in language teaching (IRAL) describes the 
rationale, method of use, and general content of Instructional 
program in German. 






















An Experiment in Teaching a Second Language ^ 
M.I. Rocha e Silva and C.B. Ferster ^ 
Institute for Behavioral Research 





INTRODUCTION 

This paper describes a semi-automatic method of teaching a rapid 
introduction to the basic structure of German derived from an operant 
conditioning analysis of verbal behavior. The predominant procediire 
is matching to sample (Ferster, 1963' Ferster, 1964). The program 
is presented to the student on 5 x 8 cards, the top part of which 
consists of a picture or a text. The student selects one of four texts 
or pictures from the lower part of the card. Reinforcement occurs 
when the student pushes the button under the text or picture which 
corresponds verbally or thematically to the sample. For example, 
in the simplest type of card, when the student hears the German "Buch", 
reinforcement occurs if he pushes the button under the picture of a 
book rather than the button under the picture of a chair or a boy; 
or a picture of a book in the center of the card might be the occasion 
on which he chooses the text "Buch" rather than the text for chair 
or boy. Sometimes the upper part of the card presents a picture 
and a text, a picture and an auditory stimulus, or a text and an 
auditory stimulus. The student hears "Where is the book?" and with the 
picture of a boy sitting on a chair and a book under the chair he pushes 
the button for the text "under the chair" rather than for "on the chair." 

The matching -to -sample procedure requires the student to perform 
as a listener and a reader rather than as a speaker and a wr.iter. Yet 










the goal of the program was to speak and write. We tested the hypothesis 
that an extensive repertoire as a listener and reader would provide the 
hasic performance from which speaking and writing could emerge. We 
reasoned that once the student could respond meaningfully and in fine 
detail to the spoken and written language, he had an internal model 
which could serve as the instant and immediate reinforcement for his 
speaking and writing (Skinner, 1957). The process is substantially 
the same as that used to teach phonetics (Smalley, 19^1) similar 
to the way a child initially acquires verbal behavior. He becomes 
an accomplished listener (no, yes, breakfast is ready, breakfast is 
not ready, etc.) long before he is a speaker because his behavior on 
these occasions’ is reinforced or not, depending on what he hears. 

The student's inaccuracies of articulation or intonation were not 
corrected at any point in the instructional program. We looked for 
improved -nt in pronunciation paced with the student's ability as a 
listener. The student began with English articulation patterns and 
we looked for their continuous shaping and redistribution. The more 
competent a listener the student became, the more he could react to his 
own behavior differentially in the direction of the standard forms of 
the second language. 

The teaching program was designed primarily as an experiment and 
was not intended to be responsible for the student's entire language 
experience. For experimental purposes we restricted the student's ex- 
perience to the automatic instructional program so that we could evaluate 
how much of an active repertoire in the language the matching -to -sample 
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procedure, alone, could develop. If we had total responsibility for the 
student's second language instruction, we could, of course, supplement 
the teaching machine experience with other methods. 

The program assumed that the student already had a highly-developed 
verbal repertoire in English, read the Roman alphabet fluently, and 
had pronunciation patterns at least roughly congruent with those of 
German. While we expected English structures and usages to interfere 
with those required in German, we minimized the interference by teaching 
German without translation. The only time the student heard English 
was at the start of the course when, for example, he had to be instnicted 
in the use of the teaching machine or the rules for the teacher-student 
interaction. Most of the instructional procedures could be carried out 
automatically by relays and other automatic control equipment since the 
student's point of contact with the program occurred when he pushed a 
button. 

METHOD 

The Teaching Machine^ 

Figure 1 is a photograph of the teaching machine into which the 
student inserts a 5 x 8 card manually. The top part of the card con- 
tains the sample stimulus which in this card is a picture. Below 
each of the four boxes on the bottom part of the card is a button. 

(The student is instinicted to press the button under the stimulus that 
corresponds to the picture or text in the center of the card,) The 
light on the face of the machine (a reinforcement for pressing the 
correct button) comes on automatically because a piece of conducting 












•-V- 



I 



foil is pasted behind the card in the poeition of the correct stimulus. 
This aluminum foil shorts one of the four pairs of contacts in the 
machine so that appropriate reinforcement or nonreinforcement occurs, 
depending on which button the student presses. On cards where the 
student listens to the spoken language, the right-hand comer of the 
card is cut away exposing a button underneath, as in Figure 2D. The 
tape recorder runs while this button is held dovm. The student learns 
to press this -until he hears the card number (in the new language) and 
the stimulus material. Tvro sharp clicks indicate the end of the 
stimulus where the student is instnacted to release the button before 
the material for the next stimulus plays. 

Sample Frames 

Figure 2 shows the kinds of verbal arrangements that were programmed 
with the cards. In Figure 2A. the stimulus is a picture (or picture and 
a text) and the student chooses one of the four texts below that corres- 
ponds thematically -with the picture. In Figure 2B the sample is a text 
and the student chooses a picture thematically relevant to the text. 

In Figure 2C the sample is a text and the student chooses the text below 
that corresponds intraverbally to the sample text. Figure 2D is an 
example of a response controlled by an auditory stimulus. Note that 
the righ-t*h:.and part of the card is cut away exposing the button under- 
neath; when the student presses the button he hears, ’’Where is the nose?”. 
Reinforcement occ\u:s if the student chooses the text, ’’The nose is in 
the middle of the face.” In some cases, the student sin 5 )ly has to pick 
out a text which corresponds, point-to-point with the auditory stimulus. 
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For example, he hears, "Jfonday is the first day of the week" and 
chooses from the texts, "Monday is the first day of the week", "Monday 
is the second day of the week" or "Tuesday is the first day of the 
week." Figure 2E is an example of a choice based on the relation 
between an auditory stimulus and a picture. The student hears "What 
is under the chair" and if he is properly controlled by "under" (as 
opposed to "on") he chooses the book rather than the boy. In Figure 
2F is a card where the werb ending is the critical stimulus. 

Subjects 

Subjects were 10 volunteer college fresliman students, chosen from 

a group of 29 , who responded to a notice throu^ the German department 

3 

at Georgetown University. St\jdents were accepted for the experiment 
if they could attend class regularly on Tuesday and Thursday, and if 
they wanted to learn German because of their interest in a foreign 
service career with the State Department. Their ages ranged between 
17 and 19; they had no previous training in German, and all were in 
good standing in their university studies. 

Probe 

Immediately following each lesson that the student completed, 
there wan a brief interaction with the teacher called a probe. The 
probe differs from the usual test because it is an attempt at direct 
measurement of the student’s performance rather than a sample of 
behavior designed to allow us to infer the state of the total reper- 
toire. The probe begins by asking the student to speak in GeriEBn, as 
much as he can, along the lines of the material in the preceding 
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lesson. Then the student is shown some of the pictures fro^ the 
lesson and finally he is prompted either textually or vocally. 

Thus the probe is designed to exhaust the student's repertoire at all 
levels from free speech at the start of the probe to a highly determined 
response at the end such as "yes" in response to the question "Is 
that a man?". The probe was carried out entirely in German. Examples 
of performances in between free speech and a highly determined response 
such as "yes" or "no", are nonverbal responses such as Sxtting down 
in response to a request, or pointing to one of several objects in 

response to "\>naich one is a ^?", 

The answer to the question of "How much behavior in the German 
language does the student have?" needs to be answered by specifying the 
degree of determination of the student's verbal response by thematic, 
textuEO., intraverbal or echoic stimuli. The probe was designed tc 
give us a measurement of the performances generated by the instructional 
procedure. We could thus have a criterion for whether the student is 
to go on to the next section, engage in a remedial exercise or repeat 
the previous section. In most cases the discrepancy between the 
student's repertoire and our criterion of mastery was sufficiently 
small so that a few minutes of tutorial during the probe was sufficient 
to correct any deficiencies. We judged that it was essential that the 
student achieve perfect mastery of the materials at each stage so that 
his performance would not be disrupted by a cumulative deficit. The 
probe also served as a reinforcer for the student's study behavior since 
it exposed in clear form his accomplishment as a result of the lesson. 






The probe emphasized the behaviors developed in the immediately pre- 
ceding part of the program, so as to give immediate evidence of 
progress. Thus the probe was a contingency designed to make progress 
in the new repertoire a reinforcer. 

Though one of the purposes of the probe was to demonstrate to the 
student, in a form slightly different from the exact form required 
during the teaching program itself, that his repertoire in German had 
in fact been substantially augmented, it also provided differential 
reinforcement in favor of those performances most effective with a 
fluent listener, ^e probe also provided direct interpersonal rein- 
forcement for the student’s speaking since the student actually 
altered the verbal behavior of his teacher in the new lemguage and 
vice versa. Since the reinforcements during the automatic phase 
of the program are for reading and listening, the probe was also 
designed to develop the analogous active behaviors, speaking and writing. 
By requiring the student to write and speak during the probes, we intended 
to alter the student's conduct during the automatic phase of the program, 
in the direction of learning how to convert himself from a listener to a 
speaker, and from a reader to a writer. In this objective, we could 
depend upon the transcriptive repertoires already effective in the 
student's first language where, for example, he could say "chair" after 
hearing "chair", or write "chair" after reading "chair." To facilitate 
the development of an active repertoire the student was told to speak 
aloud everything he read in German. 

The instructor never corrected the student's pronxmciation or 
usage during the probe since we wished to find out how much active use 
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of the language could be developed by training procedures in which the 
student is a listener and reader. Students frequently corrected their 
own errors, however, when the instructor paused after incorrect 
responses. 

Like the intermediate probes the student's achievement at the 
end of the program was determined by direct measurement of his entire 
second language repertoire rather than by a test. The student was 
progressively prompted to get him to engage in all of the German he 
was capable of under all conditions. The following instructions guided 
the student during the written part of the final probe. 

1 . Write a few sentences of any of the themes given during 
the program. 

2. Write some sentences on any other theme you remember. 

3* From the list of themes which was given in the program, 
write a few sentences about those themes about which you 
have not yet written. 

4. Go through the set of pictures which have been used in the 
frame cards and write sentences about these pictures. 

5. Write the story of the Three Little Bears (on the assumption 
that the student can tell the story in English) . 

6. Make up a short story. 

7. Go through the word list which you have learned in the 
program and write some sentences xTith the words which 
have not yet been used. 

There was then some conversation with the student to record his 
verbal fluency with samples of the same usage. Tape recordings were 
made for purposes of measuring pronunciation accuracy. The recordings 
were made both as a student read a text and as he conversed with the 



experimenter. 
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General procedure 

In the first session the subject was taught how to use the machine, 
the format of the teaching program, and he read aloud from a text 
(taken from the program) so we would have a record of his reading pro- 
nunciation. Sessions were carried out twice a week, each session 
lasting approximately 3 A of an hour, depending upon how rapidly the 
student worked. The first author was present continuously and observed 
all of the procedures. The probe, the oral interaction with the 
instructor, took place whenever a student completed a lesson. If a 
student did not complete a lesson within the allotted time, the probe 
was postponed to the next meeting after he had completed the unit. 

THE DESK2J OF THE PROGRAM 
Major programming principle 

The major programming principle is that of differentially 
reinforcing the student’s bbhavior (pushing one of the four buttons 
under the four choices). By such differential reinforcement, textual 
and auditory stimuli "in German" control the student’s appropriate 
nonverbal or verbal action as he chooses from the four texts or 
pictures below. The general principle is to bring the student’s behavior 
(choosing a text or picture) under the control of progressively finer 
details of German texts and utterances. In general we begin M'th a 
strongly determined response, and then withdraw^^^^e,^'a time, the 
sources of control of the behavior, until the^Student can react to 
the language in a full natural context. For example, in the very 
first card, a picture of a boy, girl and woman are labeled appropriately 
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the choices to the labeled pictures to find the text for the unlabeled 
figure. Lator in the program, there will be a larger inclination to 
pick incorrect choices when, for example, Junge (boy) is contrasted in 
the same card with jung (young), and Frau (woman) with Frattlein (young 
lady). The multiple choice format allowed us to use natural speech 
forms and long utterances even though the student was not proficient 
in all of the details of the stimulus at this phase of the course. The 
amount of detail of the verbal stimulus to which the student needs to 

attend is determined by how we arrange the contrasts between correct 

and incorrect choices. In the presence of the text "wer icit auf dem 
Stiahl” and a picture of two chairs, one with a boy on it, the other 
with a book on it, the student *s choice between ”daa Bach" (the book) 
or "der Junge" (boy) depends on whether the stimulus "wer" (who) 
controls the appropriate behavior in contrast with "was" (what). The 
control of the student *s behavior could have been shifted to "auf" 

(on) if the pictures contained chairs with the same objects underneath 
as above. Progressively, the student was brought under the control of 
one part of the sentence at a time. It is not until a much later part 
of the program that the student is required to distinguish between forms 

of the article in order to make a correct response. At this stage of 

the program, the article "der" was not critical since the student was 
not confronted ^rith a situation where he had to choose between die 
and der. Later in the program, of course, his reinforcement will 
depend on such a contrast. 

The program underwent successive empirical tesls, with one or two 
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subjects at a time, and was revised each time until the eriror rate 
fell to about The revisions generally involved making it easier 
for the student to choose the correct alternatives using incorrect 
alternatives which are already well established in the student’s 
repertoire and which control responses incompatible with the correct 
choice. For example, consider an auditory stimulus, "Where is the 
book" in con junctioi with a picture of a chair on which a boy is sitting 
and under which is a book. The choice of "on the chair" versus "under 
the chair" is not very strongly deteimined as compared with another 
card in which the auditory stimulus is "who is on the chair." In a 
next card the choice of "boy" versus "book" is controlled by two 
stimuli, "who" and "on" either of which, in contrast with "what" and 
"under", can control a correct choice. This type of card has been 
illustrated in figure 2P. One type of card teaches the student to 
listen to an auditory stimulus simply by choosing one of four texts 
which corresponds, point to point to what the student hears. Depending 
on how close the "wrong" texts are to the correct one, the student 
comes under closer control of the auditory stimulus. For example, 
the student mi^t hear "vier" (pronounced approximately like the 
English "fear") and selects the text "vier" from "Tlir." In this 
case both the initial "f" sound as well as the Ifinlaut sound can control 
the student’s response. The student becomes a more careful listener, 
however, when he must choose between the texts "vier" and "fiir." 

The construction of concepts 

Concepts and general classes of usage were developed inductively. 
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First we made sure all of the performances, other than the concept, 
were firmly in the student's repertoire. To bring the student's 
behavior appropriately under the control of "on, over, under, next to, 
in front of, behind" we began with a reliable repertoire controlled 
by the text picture and auditoiy "book, boy, girl, man, chair, table", 
etc. A series of pictures defined the special relation among the 
objects (the book is next to the chair, the boy is on it, and the chair 
is next to the table. A cup is on the table and a dog is under the 
table) . A series of cards then requires the student to choose a text 
thematically appropriate to the picture. The student reads "What is on 
the table?" and he chooses from "dog, book and cup" . He reads "What 
is under tte table?'* and chooses from the same texts. The meaning of 
the preposition comes from the circumstances under which it is reinforced. 
A series of questions of the form "Where is the bird?", "Where is the 
boy?*', ''Who is on the chair?", "V/hat is next to the chair?" amplified 
the control of the student's behavior by these prepositions (amplified 
the meaning) . 

Grammatical usage, such as the use of the dative or the accusative 
following identical prepositions (auf, neben, \mter, in) was developed in 
the same way. The concept was developed inductively by differentially 
reinforcing the student's response, depending upon whether the context of 
the sentence is transitive or intransitive. Here again the student was 
capable of all the distinctions required of him except the ending of 
the definite article. All that is required is that he distinguish 
between the case of the article depending on the context of tjie sentence. 
In actual practice, the student is given a large number of sentences 









such as "Der Junge ist in Ziinmer'' or "Der Junge geht in 

Zimmer." When the usage is intransitive the dative form of the article, 
dem, is reinforced; when it is transitive the accusative form, das, is 
reinforced. As before, the meaning or the concept comes from the dif- 
ferential reinforcement contingencies. The student comes to behave in 
terms of the rule whether or not he can state it formally. The student's 
repertoire is developed by the grammatical rule "that the accusative case 
is used with transitive verbs and the dative case with intransitive verbs." 
Although it might be, useful to the student to pronounce the rule after 
he can perform appropriately to it, he can still use the cases meaningfully 
and accurately, even without being able to state the principle. 

The same kind of inductive development f classes of verbal control 
was carried out with texts without using pictures. For example, the 
te:!ct at the top of the card might be "Are the dishes on the table?", 

"Are the dishes under the table?", or "Are the dishes over the table?". 

The student chooses from "bn the table, under the table or over the table." 
In developing control by "who" and "what" the text at the top of the card 
is "Tom is in the house, Fred is in the forest. There is a small plant 
in the house but large plants in the forest." Successive cards would 
then have the questions (l) Who is in the house? ( 2 ) Who is in the 
forest? ( 3 ) What is in the forest? (4) What is in the house? In each 
of the four cards, the student chooses between Tom, Fred, a small plant, 
a large plant. 

Pronunciation 

Because we wanted to test the hypothesis that we could achieve pro- 
gress in pronunciation primarily by training the student as a 
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listener we avoided direct reinforcement and punishment of the student's 
speech. We presumed that the student will almost automatically 
differentially reinforce and shape his own behavior as he hears 
differences between his own speech and the speech of the native speaker 
so long as he is an effective listener who can react to nuances of 
the native speaker's speech. Theoretically, the process we are trying 
to simulate is the same as that in which a pre -verbal child copies 
the articulation and intonational patterns of those he admires. 

Once the student can react meaningfully to the details of the 
utterances of the native speaker he has, in a sense, an "internal 
model" of parts of his language. Since he is his own listener as well 
as a speaker, the perception of the speech sounds of others already in 
his repertoire because of his past experience can serve as a differential 
reinforcer for successively approximating his own ability to speak. 

The most effective reinforcers would be those which differentially 
reinforce and successively approximate the tongue, larynx, and mouth 
patterns necessary for communicable speech. Even though the ultimate 
reinforcer that will maintain the student's speech is the change it 
produces on the behavior of a listener, it is only the instant and 
immediate consequences of speaking which are a precise enough contingency 
to differentially reinforce the subtle nuances of articulation, rhythm, 
and intonation. The effectiveness of the program, therefore, would 
depend upon whether the student talks enough to himself, aloud, so 
as to provide enough occasions go differentially reinforce his speech. 

Use of textual stimuli 



The overall rate of speech, and the length of an utterance, were 
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kept as slow and short as possible, consonant with normal rhytha 
intonation. As the student came under better control of the language 
he heard faster speech and longer utterances. We used many texts, 
early in the program, despite the likelihood that the student’s 
pronunciation would be more likely to be controlled by his native 
language than by the new one. The text has the advantage that the 
student can quickly, easily and repeatedly produce the corresponding 
auditor*' stimulus. If a response is weak, repeated exposure to the 
stimulus may lead to the appropriate behavior when one instance would 
not. ‘The auditory stimulus, in contrast to a text, is transient. 

Second, the student will sooner or later have to speak with the 
articulation and intonation of the second language while he reads 
from textual stimuli of the same orthography that controlled his behavior 
in the first language. Event\ially the texts control different pro- 
nunciation. patterns, depending upon the language, because of the 
differential reinforcement. German patterns in the presence of 
English and English patterns in the presence of German ^ > 2 extinguished . 
For exSEmple, the English speaker will initially say "dai" for the 
German definite feminine article "die" ana "din" for the German "dein." 
But as his proficiency develops as a listener, the student’s own reaction 
to his speech provides a differential result which will weaken the one 
response and strengthen the other. Such discriminations probably 
need to be formed, in any event, whenever the student will be exposed 
to texts. Such a discrimination needs to be made eventually, anyway, 
as Sapon’s experiments have shown (Sapon, I963) . 
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Use of behavior already in the student's repertoire 

The design of the program depended critically on the student's 
first language. For example, English usage provides many sources of 
strength for speaking, reading and listening in German. As a result 
the p 2 X>gram would be different. for students with different first 
languages. First, there are the cognate forms as, for example, Mann 
and man, Wasser and water, ist and is, habe and have, Haar and hair, 
and so forth. The stipplementary control from cognates in English 
and German becomes stronger when the student acquires sufficient number 
of usages in which the letters "ss" in German control the same behavior 
as the "t" in English, as in Wasser and water, Strasse and street. 

Other common elements between the two languages occur in the word 
order and parallel form, for example, the man is small, and "der Mann 
ist klein." In both English and German "the" serves as an autoclitic 
(Skinner, 1957) J a particular man is the subject of the discussion, 
rather than one of a general class. In other instances, hov;ever, 

German and Spanish are more congruent than English and German. In the 
usage as in "die Hand des Mannes ist klein" as compared with the 
Spanish "la mano del hombre es pequena", German and Spanish are more 
parallel than German and English. Where the texts control very different 
behaviors in the student's first and second languages, differential 
reinforcement eventually reduces the induction between the two 
repertoires. V/here the first and second languages have common elements, 
the texts in the second language continue to be supported by the 
first language repertoire. 
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Thematic control 



The student's highly developed verbal repertoire in the native 
language is an important factor in the teaching program. Some of the 
common repertoire comes from the student’s interaction with the physical 
environment. For exanqple, the moon shines at night, and the sun rises 
in the morning; dogs, sheep, and cows are animals, but rocks, trees, 
and water are not; birds, insects and pebbles are small, whereas 
elephants, mountains and trees are large; the same word is used for 
two in two animals as in two trees. As a result of the student's 
first language repertoire, many kinds of verbal development need not 
be repeated in the second language. Once the student identifies birds 
as small and elephants as large, he can call ants small and cars large 
without additional experience. 

Pictures provide a frequent source for achieving a thematic effect- 
on the listener. If the student is verbally fluent in a first language, 
a picture will strengthen a whole class of verbal behavior thematically 
relevant to the picture, when the student behaves verbally in the 
second language on the occasion of this picture, the same thematic 
effect on himself as in the first language will serve as a reinforcer. 
Moreover the reinforcement will be differentially effective in favor 
of those responses and intraverbal connections which have the same 
thematic effect as the picture did in the first language. 

Initially, the program draws upon behaviors which can be evoked 
directly by pictures, such as a man, a boy, a table, or a person 
eating. Many verbal practices, however, do not fit this paradigm, and 
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the latter stages of the program use thematic sources of strength 
from the student's native language as a method of transferring a 
verbal practice from English to German. For example, constructions 
such as "once upon a time", "yesterday", "however", and "if" have 
no pictorial coimterpart . We taught these kinds of verbal usage 
by thematic control from the context in which they are used, much 
as a child comes to be controlled by the word "frigate" because the 
word appears in the context of sails, sailors, ocean, etc. Contexts 
in which the student encounters the new words, teach their "meaning" 
because the behavior controlled by these words is reinforced or 
extinguished depending on its compatibility with the normal thematic 
and gr amm atical control by the rest of the sentence. If, for example, 
the word "frigate" happened to strengthen verbal responses other 
than those thematically related to ships, those responses would go 
unreinforced and hence be weakened. If "frigate" controlled verbal 
responses thematically related to ships, those responses would be 
strengthened. The development of complex language in German is 
simpler if the stuv^tent already has these forms in his native language. 
For exan5)le, if the student already knows the story of The Three Bears 
in English, then the words "once \ipon a time", "a long time ago", 

"many years ago", "in ages past", etc. vdll deidve strength from the 
comparable context of the story in the native language. Futhermore, 
related variations of this expression will supplement each other 
because of their common elements, all of which are related to time 
in the student's existing repertoire. For example, the phrase "once 
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upon a time" vill influence the student appropriately partly by its 
position at "the beginning of the story because of the student's 
ejqperience with this phrase in the first language. 

Theoretically we expected that the student's behavior in German 
would be reinforced by the thematic effect on himself as a listener 
that comes from his experience with The Three Bears in English. The 
general plan, therefore, in this technique of programming is to 
detennine some behavior in the student thematically so that the 
reinforcement for the second language is "to have the same effect on 
himself." The following paragraph is an example of thematic programming. 
This text occurs in section 13 of the program. (The student has been 
taiight all of the usages except those underlined). ’ T3ie -thematic 
effect of the story serves as a reinforcer developing the new verbal 
control . 

In einem grossen Garten ist ein kleines M&dchen. Sie heisst 
Helene Biilow* Helene hat einen Bruder. Er heisst Wolfgang. Er 
ist auch in dem Garten. Helene geht urn den Garten herum und sie 
sieht Wolfgang. 

-"Hallo Wolfgang. Guten Morgen." 

-"Wo gehst du hin, Helene?" 

-"Ich bringe der Mutter diese Blumen. Es sind sechs rote Rosen . 
Siehst du, Wolfgang, wie grbn die Blotter sind? Das Gras imd die 
grossen B&ume sind auch grbn . Aber die Rosen sind rot wie die Lippen. 
Dieser kleine Busch ist auch grbn . Aber die Rosen die ich der Mutter 
bringe sind nicht grbn . Die Farbe der Rosen ist rot, die Farbe der 
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The same result could have been accomplished, using only texts, if the 
student were already under the appropriate control of the verb tenses, 
as in the following examples* 

Stimulus Response Alternatives 

I went to the store. Yesterday, Tomorrow 

Yesterday, Tomorrow 
saw, see 



I will see him. 
Yesterday I him. 



English provides important sources of strength for German, particularly 
in usages such as in the following sentences. 

If the substance is made out of metal it will attract a magnet . 

To succeed, work hard* 

All men are mortal, some men are spiritual. 



When you are in Florence, you should see the museum. 



The major stimulus in the first sentence is ”if (a substance) will attract 
a magnet". The phrase "If the substance is made out of metal" instructs 
the listener when it is appropriate to say that a substance will attract a 
magnet. Such a usage has been called an autoclitic by Skinner (1957) and 

the general control by If.. then........ is an autoclitic frame. 

We assumed that we did not have to teach many of these kinds of usages 
since German and English have very parallel forms. However, were they not 
parallel and at those points where the student does not have the needed 
repertoires, the general techniques of the teaching program could be 
easily extended to teaching these. In that event, the program could teach 
young students who have yet to learn a first language. 

Review 

Review of previously learned materieil is carefully built into the 
program but never accomplished by repetition. Practice of already acquired 
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materials is carried out by requiring the earlier usage in an expanded 
context. For example, thematic usage developed in one section will be 
reviewed in the next which teaches the proper use of the definite 
article. Review is also carried out by programming progressively finer 
contrasts between the response alternatives. The same picture or text 
may control the same choice but the alternatives give a greater chance 
of confusion because the incorrect alternatives have more plausibility. 

One way to review old usage in a new context is to increase the length 
of an auditory stimulus. For example, a student who can choose a picture 
of a boy when he hears or reads Junge will be less able to do so, in the 
context, **Is the boy or girl sitting on the chair?" The choice of a 
response will be even less sure when the response alternatives, as well 
as neighboring cards make it possible for the boy to be on the table as 
well as the chair, depending on the picture. Such expanded contexts 
provided much of the basis for the review. Contrasts between usages are 
carefully programmed beginning with stimulus choices which control behavior 
strongly incompatible with the correct choice. Once the student *s behavior 
is reliably controlled by one level of contrast, the contrasts are made 
finer, paced with the student *s ability to sustain the distinction. Thus 
the stimulus and the reinforced response remain the same with only the 
unreinforced alternatives varying. Thus the review is accomplished as 
the student deals with the old usage in new contexts. The procedure is 
very similar to that used by Smalley (1961). 

RESULTS 

Error rate during the program . 

Of the ten students who elected to take the program, two could not 
continue because of schedule conflicts with their regular acadmic program. 
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Seven out of the remaining eight students finished the program. None 
of the students needed to repeat any part of the program* The average 
number of errors during the program varied between 2^ and 3^. Errors 
were concentrated mainly in sections 3 and k. Students M, B, C, and E 
went through the program with an average error rate of 2^. Students 
D, W> and McL*s average error rate was 3%» 

Performance on the written intermediate probes (following six lessons ) 

The students* mistakes will be reported in the following categories: 
Sentence structure 

a. Completely wrong form. 

For example: Die Ttir und die Vorderseite ist des Houses , 

b* One or two word order reversals* 

For example: Jede Mutter hat mit einem Mann Kinder 5 

nicht wohnt; auch frisst. 

Word form 

c* Wrong form of nouns and modifiers* 

For example: mit die Biene_^ und die FUsse^* In dem grosse 

Hause* Die Schaf* Per Auge* Der Sohn hat ein Hund» 
d* Wrong verb form* 

For example: das MSdchen und der Junge trinkt* 

e* Various* 

For example: nicht instead of nein; auf dem Glas, instead of 

au£ dem Glas* 

Spelling 

f* Letter reversal. 

For example: nien instead of nein; wonht instead of wohnt* 




■ ■ \ 



\ 



\ 



-25 



g. Letter omission. 

For example: Sttt^le; Tis_Jie. 

h* Various • 

For example: Inse£kten instead of Insekten; Phlanze instead of 

Pflanze; .AmeisjLe instead of Ameise. 




Table 1 is attached. 



Table 1 gives each of the student’s errors in the probe as percent of 
the total number of responses. The results are separated by category 
of error. The letters in the table refer to the categories described 
in the text. The probes consisted of sentences written by the student 
in answer to questions given on the tape recorder about a text heard 
and read by the student prior to the probe. The results of the oral . r 
part of the probe will be treated separately. 
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The following are examples of some of the behaviors required in the 
probes end the possible kinds of errors. In the section U probe the 
student wrote with the indirect object, in answer to the question wo. A 
response required of the st-udevrt might be as follows: 

Der Baum ist neben dem grossen Hans imd der Vogel ist auf dem Kaus. 

In the section 6 probe most of the sentences also involved the in- 
direct object. Two sentences with the possessive were eilso included. 

One of these latter sentences was: 

Die TUr ist an der Vorderseite des Hauses. 

In the section 7 probe the direct object was added. For example: 

Die Katze hat einen langen Schwanz. 

In the section 9 probe the students comnosed sentences. Twenty-three 
words were chosen from the preceding section in the program and the student 
was asked to compose sentences with these words. 

In the section 12 and lU probes all the usages developed in the 
program were involved. The questions required more complex answers. 

For example: 

Fine kleine Familie wohnt in einem grossen Haus in der Nfihe des 
Waldes. Der Sohn hat einen kleinen Hund und die Tochter hat eine kleine 
Katze. 

Even though the student did not have to write or speak to a listener 
during the automatic part of the program, t-'^e performances during the 
intermediate written probes showed considerable ability to write and speak 
appropriate to the material of each lesson. Sentences which were not 
understandable to the instructor were an exception. The percentage of 
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errors in declined forms was relatively low and tended to decrease as 
the students advanced in the program. The errors in spelling were also 
relatively few and tended to decrease. 

Pronunciation development 

Students began to correct pronunciation errors, themselves, as early 
as section 2 (students M, E, E, and McL.) or on section 3 (students D, C, 
V7), Student V7*s self -correction occurred less frequently but became more 
regular after section 5» A student’s first attempt at self-correction 
was not always successful. Up to section 8, students M, B, and E corrected 
difficult pronunciation patterns more successfully when they heard the 
correct form. After section 8, however, these students were able to pro- 
nounce difficult sounds correctly even in the absence of auditory stimuli. 
For students W. ana McL., correct pronunciation in the absence of auditory 
stimuli occurred only after section 10. 

As a general rule, the level of accuracy in pronunciation was lower 
at the beginning and higher at the end of the section. For students 
M, B, and E this level did rise progressively after section For the 
other students, the progress up to section 10 was slower. 

Student M. (training in French and Latin) reversed the and ei 
phonemes. He overcame this difficulty by section Although he had 
difficulties with the Umlaut B, tt and E, the ch (Buch) , the initial ^ 
or ^ sounds (Zunge, zwei) - he progressed fairly rapidly toward a 
credible pronunciation in these sounds. 

Student B . (quite fluent in French - some training in Latin) 
reversed the ic and ei phonemes. This problem was solved by section 3. 

His main difficulties were: the Ifcilaut 15 and ii, the ch sound and the 
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initial ^ and ^ sounds. His progress in these sounds vas very slow 
until section He had a tendency of stressing the final syllables (as 
in French) , 

Student E , (training in French and Latin) reversed the ^ and ei 
phonemes. This problem was solved by section 2, He had some difficulties 
with ch, initial £ and zw sounds. His progress in these sounds was fairly 
rapid. He had no trouble with the IMlaut and his general initial level 
in accuracy was the best. 

Students C, D, W, and McL , had problems with all the new soimds in 
varying degrees. 

Student C , (a small amount of training in French) reversed ^ and ei 
phonemes, until section 3, He had difficulties with all the other German 
sounds. From section ^ onward, he repeated difficult sounds (such as 5^, 

U, ch, end sounds of r, initial ^ and zw, etc,) to himself. In his 
self-corrections he improved first in the "Itolaut”, and next in the ch. 

By section 10 he was showing a general in^jrovement , 

Student D , (training in French) had no problems with i^ and ei 
phonemes. He had the same general difficulties as Student C, His pro- 
nxmciation of the "ifcilaut'' began in5>roving at section 6 and his progress 
was slower than that of Student C, 

Student W , (training in French and Latin), He reversed ie ei 
phonemes up until section 8, From section 3 onward the frequency of 
reversal became lower as his self-correction in these phonemes became more 
frequent. But he very often relapsed into incorrect pronunciation until 
section 8, The difficulties with the "Umlaut" H and with the ch. sound 
followed the same pattern as those of ie and ei reversals. Though 
there was gradual improvement, he frequently reverted to less 
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accurate prommciation of the and the ^ even after section 10. 

Student Mc.L . (5 years of Spanish in high school). This student 
had far more pronunciation difficulties than all the others. His first 
reading test was even far from the rough initial approximations of the 
other students. By section 2 he began to correct himself but even the 
corrections were not successful. He also failed in his attempts to 
correct the initial zv and ch (as in Buch) even though the frequency 
of his repetitions was much higher than the other students. By section 5 
however he pronounced most of the Umlaut sounds in a very acceptable form 
except in Biicher where the difficulties with the combination of the two 
soimds in one word disrupted the performance. By sections 9 and 10 his 
pronunciation of even the most difficiilt sounds had greatly improved. 
Considering his initial difficulties, this student *s progress was the 
more dramatic. 

While the students^ pronunciation showed English influences even 
after the program, we judged their progress toward correct patterns was 
at least that achieved by most students after a semester of study in a 
conventional college course. 

Rate of work 

Table 2 shows the amount of time each of the seven students spent 
taking the teaching program. 
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Table 2 



Hours of work 



Students 


. 

on the 


on the written 


with the 


Total 




i program 


intermediate 

probes 


monitor* 




E 


« 

i 8.17 


1.50 




14.20 


M 


^ 7.10 

! 


2.05 


5.10 


14.25 


D 


8.02 


2.10 


k.ko 


14.50 ' 


B 


8.59 


1.50 


U.35 


14.44 


C 


' T.U5 


1.55 


5-15 


14.55 


Me .Xt. 


9.27 


1.55 


5.i^0 


17.00 


W 


9.55 


2.30 


6.20 


18.45 



* Oral probes and correction of the written probes 

The total time to complete the program ranged from lU to 18 hours with 
about h6df of the time spent on the written probes and in oral interaction 
with the monitor. The time spent on each card ranged between 20 to 30 
seconds • 

The Final Probe 

The students wrote from 5 to 15 sentences in each of the seven parts 
of the probe. Each student wrote between 60 and 90 sentences in all. 

Students M, and E wrote sentences using most of the declined 

forms taught in the program and comi»sed new sentences, not used in the 
program. The two students, whose error level was highest, McL. and W, 
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composed sentences which were closer to the structures and word forms 
taught in the course. 

In the following data, the students* errors are reported as errors 
in sentence structure, word form and spelling. A few sentences taken 
from each student *s prohe are also given to illustrate the general form 
of their compositions, which were written without any thematic or textual 
support. The letters refer to the details of structure, word form and 
spelling described on page 2k, 

Student M wrote a total of 98 sentences. 

Errors 



sentence structure 

1 


vora fo™ ' 


spelling 


i a 

I 


b 


c ' 


d 


e 


f 


S 


h 


1 0 

1 

1 


k 


19 


0 


k 


1 

i 


2 


3 



Ein haus ist in der Mitte des Gartens und in der Nfihe des Waldes. 
In diesem Haus wohnt eine Familie mit vier Personen, ein Vater, eine 
Mutter, ein Sohn und eine Tochter. Der Sohn geht in den Wald. In dem 
Wald wohnen die Tiere und die Pflanzen. 

Student B wrote a total of 9 I sentences. 

Errors 



sentence structure 


word form 


spelling 


a 


b 


c 


d 


e 


f 


g 


h 


0 




23 


5 


0 

1 


1 


T 


3 
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Er wohnt in ’’Mars” aber er hat zwei Ohren an bexden Seiten des 
Gesichtes* Das Haar der Frau ist lang aber das Haar der M&iner ist 
kurz. Diese Bl&tter sind nicht grUn; der Baum hat kein Wasser. Das 
Gras um den Baum henim ist nicht griln* 

Student C wrote a total of 76 sentences. 

Errors 



sentence structure 


word form 


spelling 


a 


b 


c 


d 


e 


f 


g 


h 


0 

f 

! 


0 


21 


2 

1 


1 


2 

( 


i ^ 


7 

i 

' 1 



Die Sonne geht auf, Es ist fHih. Ich liege in meinem Bett; ich 
schlafe nicht. Ich bin wach. Ich gehe in das Esszimmer. Mein Vater, 
meine Mutter und ich essen Brot mit Honig Oder Butter. Wir trinken 
Kaffee mit Milch Oder Zucker. 

Student D wrote a total of 65 sentences. 

Errors 



^ - — 

sentence structure 


] 

word form 


1 

spelling 


a 


b 


c 


d 


e 


! 

f 


! 

g 


h 


2 

1 


0 

r 


11 


0 


0 


0 


3 


9 



Ich bin ein Student in der Georgetown UniversitSt. Ich studiere 
Deutsch. Ich bin achtzehn J«ihre alt. Meine Brtider sind Tim, Pat und 
Mike. Ich habe keine Schwester. Pat xmd Mike sind Zwilinge. Sie 



sind zehn Jahre alt. 



t 
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Student E vrote- e total of 63 sentences. 
Errors 



sentence structure 


word form 


spelling 


a 


b 


c 


d 


e 


f 


6 


h 


0 


2 


22 


1 


0 


2 


5 


0 



Auf dem ersten Bild ist ein Stuhl vor dem Tisch und auf dem Tisch 
Bind ein Glas xind ein Teller. Auf dem zweiten Bild ist ein Haus. Ein 

Baum ist vor dem Haus und ein Vogel 1st uber dem Haus. Die anderen 

If ’’ 

Karten haben Baume mit wenigen und vielen Blattern. 

Student Mc.L vrote a total of 67 sentences. 

Errors 



sentence structure 


word form 


spelling 


a 


b 


c 


d : 


e 


f 


g 


h 


3 




31 


1 


3 


0 


5 


1 
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Ein Vater und eine Mutter haben zwei Kinder. Der Mann ist der Vater 
tijid die Frau ist die Mutter. Das MUdchen ist die Tochter und der Junge 
ist der Sohn, Das MSdchen ist elf Jahre alt und der Sohn ist vierzehn 
Jahre alt. Diese kleine Familie vohnt in einem grossen Haus. 

Student W wrote a total of 82 sentences. 
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Errors 



sentence 


structure 


word form 


spelling 


a 


b 


c 


d 


e 


f 


g 


h 


0 

\ 


3 

' 


33 


2 


0 


8 


7 


15 



Die Personen trinken Bier aber die Katze trinkt Milch. Eine Person 
isst Brot mit Butter und Honig, Die B&ren fressen auch Honig. Die Bftren 
leben in dem Wald. Die Bfiren sind grosse Tiere. Sie schlafen in dem 
Gras unter dem Baum. 

The following text composed by Student C during the final written 
probe is an example of the range of structures and usages of idjich the 
student is capable at the end of the program. 

1. Bitte schreiben £ie einige sBtze Uber ein Thema des Programmes. 

if 

Dj^jf Sonne geht auf. Es ist frUh. Ich liege in meinem Bett; ich 
schlafe nicht. Ich bin wach. Ich gehe in das Esszimmer. Mein Vater, 
meine Mutter und ich essen Brot mit Honig Oder Butter. Wir trinken 
Kaffee mit Milch und Zucker. Mein Brader und meine Schwester sind nicht 
in dem Esszimmer. Sie sind in dem Schlafzimmer; sie schlafen. Die Betten 

H 

sind in dem Schlafzimmer, \md ein Tisch und viele St tile sind in dem 

A 

Esszimmer. Es ist Sonnabend. Ich leme Deutsch in der Georgetown 
Iftiiversittit. 

2. Bitte schreiben Sie einige Stitze tiber ein anderes Thema des Programmes. 

Helene Btilow ist in einem Garten. Es ist ein kleines Mtidchen. Sie 
haj^t viele Blumen in de^ Hfinde^ . Der Vater dieses ^^l^es Mtidchen ist 
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Herr Billow und die Mutter ist Frau Billow. iDer Bruder heisst Wolfgang. 

Wolfgang sie^t Helene in dem Garten. ”Guten Morgen, Helene. Wie geht 

l/J 

»»Danke, und^5^J(^Jy^?" "Danke, gut." "Geh^en wir in dfi^jd Haus und 

trinken wir Kaffee und essen wir Brot mit d^^ Mutter." "Ja, gut." 

3. Hier ist die Liste der Themen des Programmes. Bitte schreiben Sie 
einige sRtze ilber die anderen Themen. 

Das Haus ist in der WShe des Waldes. Es ist auch in der Mitte des 

N 



Gartens. Das Haus hat eine Vorderseite und drei Siete^ . Eine Tilr und 

ein Penster sind ^n deyl Vorderseite und drei Fenster sind fn Jede^ 

Seite, Das Haus hat auch ein Dach. Das Dach hat auch ein Fenster. Das 

Dach hat keine Ttir. Eine kleine Familie wohnt in dem Haus. Der Vater 

und die Mutter sind die Eltern und der Sohn und die Tochter sind die 

H 

Kinder. Ein Tisch und viele Stifle sind auch in dem Hause. Viele Tiere 

leben in dem Wald. Pflanzen leben auch in dem Wald. Die B&ren und die 

BSume sini in dem Wald. Die Blumen sind in dem Garten. 

Hier sind einige Bilder des Programmes. Bitte schreiben ^ie einige 
SEtze tber diese. Bilder . 

(ICf 

Die Kllhe und die Katzen trinken Wasser. Tiff, Schaf frisst Gras und 
das Pferd friast Blotter. Der Junge isst Brot mit Honig Oder Butter. 

Die Blume ist oTfen. Der Junge hat viele Haare. Ein Mann hat keine 
Haare und der aniere^ hat wenig. Der Elefant hat einen grossen Kbrper 
und der Vogel hat einen kleinen Kbrper. Der Junge isst ftpfel. 

Viele fefel sind in dem Teller \ind zwei Upfel sind auf dem Tisch. Die 
Schachtel ist of fen. Ein^^ Schu^ ist neben den Schachteln. Die Tasse ist 

zwischen den Schachteln. Die grosse^ Schlange hat einen lange^ Schwanz, 

S/fb 

und die kleine^ Schlange hat einen Schwanz. Das MSdehen trinkt 

Milch. 
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5. Hier ist die Liste der WBrter des Programmes* Bitte schreiben Sie 
einige SEtze mit diesen WBrtern. 

Der Vogel hat zwei Fltigel. Der Hund lebt in dem kleinen Haus. 

Eine Person hat zwei HSnde* Die Fliege ist ein^ Insekt* Der Hals ist 
zwischen dem Kopf und dem Rumpf. Die Lippen imd die Rosen sind rot. 

Ju^ 

Sonne ist gelb. Die ZEhne sind in dem Mund. 

6. Bitte schreiben £ie SEtze Uber "Die drei BEren" die in dem 

Wald wohnen. 

Die drei B&ren leben in dem Wald* Der Vater und die Mutter und der 
Sohn fressen Honig. Die Biene mach^ Honig, Die BEren gehen jlji den Baum mit 

dem Honig. Es ist nicht gut. Die BEren habeu nicht Honig. Bicnen 

i/V 

haben d^^ Honig. Die BEren schlafen nicht in dfip Bett. Sie schlafen in 

dem Wead. In Dec^ember, iir Januar und in> Februarlsle ) schlafen.) "Die 

* M ^ 

BEren sind in diese^Wald." Die^ersonen gehen nicht in diese^ Wald. 

The final oral probe 

The oral probe consisted of a conversation with the instructor and 
questions about some of t^te pictures presented in the program. The 
following was the conversation with Student E taken from the tape re- 
cording. The texts are presented as approximations of their vocal 
counterparts. How closely the student *s pronunciation conforms to standard 
forms has been discussed already. 



Teacher 

1. Guten Tag. 

2. Wie geht es Ihnen? 

3. Danke, gut. Wie heissen Sie? 

4. Wie alt sind Sie? 

5. Sind Sie ein Student? 

6. Wo studieren Sie? 

7. Wo wohnen Sie? 



Student 

Guten Tag. 

Danlce, gut. Und Ihnen Frau Silva? 
Ich heisse Evans. 

Ich bin zwanzig Jahre alt. 

Ja, ich bin ein Student. 

Ich studiere in der Georgetown 
UniversitEt . 

Ich wohne in Massachusetts. 
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8. ¥o wohnen Ihre Eltern? 

9* Haben Sie viele Brttder? 

10. Haben Sie auch Schwestern? 

11. Wie heissen Ihre Schwestern? 

12* Wie alt sind Ihre Brlider? 

13. Herr Evans, sagen Sie mir, bitte, 
die Tage der Woe he. 

lU, Welcher ist der erste Monat des 
Jahres? 

15* Und der letzte? 

16. Herr Evans, welche sind die 

Artikel auf Deutsch? 

17. Wie schreibt man die Substantive 

auf Deutsch? 



Sie wohnen auch in Massachusetts. 

Nein, ich habe nur zwei BrUder. 

Ja, ich habe zwei Schwestern* 

Meine Schwestern heissen Ora und 
Mara. 

Meine BrUder sind ein-und zwanzig 
xmd zehn Jahre alt. 

Die Tage der Woche sind: Montag, 

Dienstag, Mittwoch, Donnerstag, 
Preitag, Sonnabend, Sonntag. 

Der erste Monat des Jahres ist 
Januar. 

Der letzte ist Dezember. 

Die Artikel auf Deutsch sind der, 
die, das, ein, eine. 

Mit einem grossen Buchstabe. 



At this point the student was shown pictures, as indicated, and the student 



responded to oral questions. 



18. Was ist das? 

19. Was sind diese Tiere? 

20. SchlUft dieses Mfidchen oder 

ist sie wach? 

21. Und diese Person en? 

22. Wo ist dieses Buch? 

23. Und die Tasse? 

2U. Wo ist dieser Junge? 

25. Und dieser? 

26. Wieviele Blicher sind offen? 

27. Und wieviele sind geschlossen? 

28. Ist dieser ^fenn alt? 

29* Und dieser? 

30. Wie hUlt diese Frau das Baby? 

31. Wer hat lange Haare, der Junge 

Oder das MSdehen? 

32. Wo sind die Ohren? 

33. Wo ist der Ellbogen? 

3h» Und die Nase? 

35. Wo sind diese StUhle. 

36. Gut, danke Herr Evans. 

37. Auf wiedersehen, Herr Evans. 



Das ist ein Wald. 

Diese Tiere sind BUren. 

Dieses MUdehen schlUft. 

Diese Personen sind wach. Sie 
liegen auf dan Boden. 

Unter dem Stuhl. 

Die Tasse ist neben der Flasche. 
Dieser Junge ist hinter dem Baum. 
Dieser Junge ist vor dem Baum. 

Ein Buch ist offen. 

Zwei BUcher sind geschlossen. 

Nein, dieser Mann ist Jung. 

Dieser ist alt. 

Sie hUlt das Baby in beiden Armen. 

Das MUdehen hat lange Haare. 

Die Ohren sind an beiden Seiten 
des Gesichtes. 

Der Ellbogen ist in der Mitte des 
Armes. 

Die Nase ist in der Mitte des 
Gesichtes . 

Diese StUhle sind urn den Tisch henim. 
Bitte, Frau Silva. 

Auf wiedersehen, Frau Silva. 













DISCUSSION 



For purposes of our experiment we have restricted the student *s 
experience to the multiple choice procedure and the probes. Nevertheless, 
the student gained proficiency as a speaker and writer even though his 
training experiences were, with limited exceptions, restricted to listening 
and reading. There was a substantial rate of development of ability to 
pronounce the language, despite the absence of any e:q)eriences in which 
the program provided dxrect consequences for the student's pronunciation. 
These results supply confirmation to our hypotheses underlying the basic 
construction of the program that training the student as a listener would 
influence proficiency in speaking. Nevertheless, we do not recommend this 
program as a sole experience, since other types of procedures are useful 
for different outcomes. Yet it is clear that it is possible to develop 
an ictive use of basic parts of a language with a simple automatic program 
tafcn over a short period of time. 

After taking the program, the students pronou 5 German sufficiently 
well that any German listener would have no difficulty in understanding 
then; nevertheless, their approximation of correct German pronunciation 
is ssill gross, and we do not know how closely an approach as outlined 
here can approximate the nuances of German pronunciation we refer to as 
a good accent. 1 ., seems reasonable to expect that new conditions of rein- 
forcenent are required to produce exact conformation to German pronunciation 
patterns beyond that which is required simply to have a native listener 
understand. In any event, it seems reasonable to experiment with procedures 
that postpone such experiences until the student has mastered many of the 



other aspects of the use of the language. The critical research that 
will he needed will he experiments in which the point-to-point change 
in the students* pronunciation is measured as a function of different 
levels of proficiency as a listener. The use of the teaching program as 
a pracoical classroom device would he limited hy the large amount of time 
needed to administer the prohe. Although the prohe was not a teaching 
device in the usual senje, we judged it to he an important factor in the 
program’s effectiveness. Many modifications of the prohe procedure used 
in this experiment could he proposed as a result of our experiences. Some 
of the functions of the prohe could he carried out in a group in the class- 
room, where the students in recitation, conversation or oral examinations 
could demonstrate the newly acquired repertoires. We have begun to experi- 
ment with probes which are semi-automatically administered through appro- 
priate texts and tape recordings. These lank, however, a siire criterion 
to objectively determine whether the student has achieved sufficient 
mastery to go on to the next lesson. Perhaps a solution might; he a com- 
bination of autcmatic probes, classroom procedures and periodic diagnostic 
tests. Despite the large amount of time spent with the probes, they did 
not instruct in the usual sense that we speak of teaching. The major event 
in the prohe was that the student was given an opportunity to observe his 
own achievement. We judge this reinforcer to he an imi>ortant factor in 
the effectiveness of the program. Even though the prohe did not teach in 
the usual sense it provided a reinforcer which determined the form of the 
student’s behavior as he operated the teaching machine. 



The program which we described is only a first approximation and 
will require significant modification as a result of experiences with the 
first test and subsequent, more extensive testing. Major problems of 
redesign should include a more rational basis of the choice of the initial 
vocabulary, more natural usage, and the sequence by idiich it is included 
in the program. 

The present experiment used English-speaking students, whose basic 
pronunciation patterns and general, structure of the native language is 
very similar to that of German* Since one of the properties of the program 
described above is the potentiality of transcribing it, almost directly, 
into many other languages, additional research will be required in studying 
the problems raised by differences among languages* Many of these problons 
might be anticipated by linguistic analyses* These problems will be more 
acute where either the native language or the second language contains pro- 
nunciation patterns ;daich are very different from those in the language 
to be taught. 

We are extending the same principles and technique to the problems 
of dislexia and reading instruction with young children* Just as with 
second language instruction, the matching-to-sample procedure, with the 
probe procedure, is a way to teach reading automatically without direct 
reinforcement of the student’s vocal behavior. 

While the experimenters had some training in phonetics and could 
make at least a rough phonetic analysis of the student’s responses, the 
results were reported only in enough detail to convey gross changes. To 
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measure the effects on pronunciation patterns of training the student 
as a listener, more careful ea^Jeriments are needed, such as: 

1. Careful measurement of the student’s initial pronunciation 
patterns, as a speaker, a reader, and in free speech. 

2. Training of the student as a listener, carried out objectively 
so that the change in the student’s articulation can he related point to 
point to the changes in the student’s perception of the soxmds. 

3. A phonetic analysis of the changes in the student’s pronunciation. 
We take the results of the present e:q>eriment, however, to confirm the 
importance of the listening function and encourage us in the direction 

of more fine grain experiments. We Judge that the reason other investi- 
gators (Liheman, 1957; Mace, 19^5; Underwood & Schxiltz, I960) have not 
confirmed this hypothesis is that the training of the student as a 
listener did not use critical contrasts during the discrimination training 
so that the student was not forced to attend to the details of the 
spoken sounds that form the basis for the fine grain articulation patterns 
that are necessary for accurate pronunciation* 
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Footnotes 



1, This research was carried out under Contract No. DA-U9-193-MD-25T7 
with the Office of the Surgeon General and Grant No, 5-K3-MH-5T^^ 
of the National Institutes of Mental Health, 

2, We are indebted to Father E, P, Dineen, Professor of German at 
Georgetown University, for making the experimental test possible, 

3, A first -version of the German program was written by Irene Jones 
under the supervision of C, B, Ferster, M, I, Hoeha e Silva was 
responsible for a radical revision, extension of the content and 
scope of the program, and the empirical trial at Georgetown VJniversity. 
C, B, Ferster was resi)onsible for the functioned analysis of verbal 
behavior and its extension to the program construction, 

h. We are indebted to the Department of Design, Southern Illinois 

University and Professor Harold Cohen for their help in redesigning 
an eeirlier version of the teanhing machine. 
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Figure !• 



A photograph of the teaching inachine used for the matching- 
to sample procedure* 



Figure 2. Six sample cards from the teaching program illustrating the 
verbal arrangements that were used on the cards during the 
program* The ’’text”, exposed by the cutaway portion of the 
card, indicates the auditory sample which the student hears 
when he presses the button* When the card is intact the 
student responds to the text, picture, or combination of 
picture and text at the top of the card. 
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Vletnamese 

The Vietnamese program, modeled after the German in content 
programming technique and general method of classroom applica- 
tion, was used mainly as a baseline for the experiments which 
measured the effects of motivational variables. Nevertheless the 
program, despite Its lack of empirical revision and some of the 
subtleties of design present in the German program, turned out to 
be surprisingly effective as a teaching Instrument. A pilot ex- 
periment carried out by the I6R at the War College with ten Army 
Officers was successful enough that the Institute for Behavioral 
Research has submitted bids on teaching contracts to apply the 
teaching program and methods more broadly to military training 
problems. 

Experiments with the Vietnamese show the possibility of 
adapting the general approach to other languages even though they 
are quite different from German. Vietnamese, for examp. le, is a 
tonal language much less congruent to English than German. 
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II. 

The Effects of Listening Discrimination Training l^on Echoic Accuracy 

INTRODUCTION 

In teaching a second language to students a problem that 
frequently, if not invariably, arises is the necessity for the 
student to learn to pronounce certain sounds which are not in '’is 
first language repertoire. Sometimes these sounds are merely a 
novel combination of two or more sounds that the student already 
produces. In other cases, sounds very different from those present 
in the subject’s repertoire need to be learned, sounds which may 
necessitate learning responses incompatible with his first language. 
Teaching a second language, using techniques of programmed instruc*' 
tlon, does not eliminate this problem. In fact, it makes the prob*> 
lem even more difficult to solve since an Instructor is not 
present with the student to shape his speech into the correct 
pronunciation forms. It is, therefore, of some practical as well 
as theoretical interest to investigate various procedures for the 
development of good pronunciation which could be accommodated 
within a programmed language course. 

One of the first procedures that suggests Itself for this 
task is that students be trained to dlsicingulsh between correct 
and incorrect pronunciation. Thus the students might be better 
able to listen to and "shape” their own vocalizations toward correct 
pronunc la t ion . 






1 



Listening Discrimination Training 



This hypothesis Is the one that served as the basis for the 
design of the Vietnamese and German Instructional programs which 
were also developed under this contract (Ferster and Silva, 1966) « 

In these courses of Instruction and program materials the student 
Is trained as a listener and a reader while the performances re- 
quired of him are those of speaking and writing. The results of 
these experiments suggest that the listening and reading repertoires 
are effective steps toward developing speaking and writing. How- 
ever, to date very few controlled laboratory studies have been re- 
ported In which explicit measurements are made of the relation be- 
tween these repertoires. Lane and Schneider (1963) employed an 
echoic task where subjects mimicked a Thai phoneme. The response 
parameters of Interest In this study were the correspondences In 
pitch slope (rate of change In pitch) and response duration be- 
tween the echoic stimulus and the subject's echoic response. 

Following the echoic task subjects listened to a tape on which 
five different Thai tonemes were presented In Irregular order. The 
subjects were trained to make a response only when the toneme pre- 
viously used as the echoic stimulus was heard. Lane and Schneider 
found that this type of discrimination training produced little Im- 
provement In subjects’ echoic accuracy. 

Plmsleur, Mace and Kelslar (1961) and Plmsleur (1963) have 
reported the effects of listening discrimination training upon high 
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school students' pronunciation of French woraj. In one part of 
the study (Final Experiment I) a listening discrimination pro- 
cedure was programmed in which subjects discriminated between 
French words which contained the French foj and the typical 
American mispronunciation of these words which contained a dip- 
thonged (1^6 American mispronunciations were actually English 

counterpart words.) After some preliminary training, subjects 
heard each word and responded indicating whether the pronunciation 
was French or American. Although the subjects were relatively 
accurate In discriminating between the French words and the English 
counterpart words, their pronunciation of the French words when 
they read them from a list was no better than the pronunciation of 
subjects in a control group who received no prior listening dis- 
crimination training. However, two qualifications should be added. 
Apparently the French words on the listening discrimination tape 
were pronounced by a different person (or persons) than were the 
English counterpart words. It seems at least possible then that 
the accuracy of subject's Judgment in telling French from English 
pronunciation could be due to subjects making a discrimination be- 
tween the voices of different speakers rather than between the 
French and the English words per se . Another complication of these 
experiments is the control of the pronunciation patterns by the 
textual stimuli. It is well know to linguists that a student who 
may pronounce a second language appropriately on imitation is 
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llkely to shift to an English pronunciation pattern in the face 
of a textual stimulus when he reads. Further, after the pronuncla- 
tlon test was completed -- a response Indicating whether the word 
heard was a French one or an English counterpart one was read- 
ministered to the experimental subjects and administered for the 
first time to the control subjects (Pimsleur, ^^ace ^nd 
1961). While the experimental subjects wez'e more accurate on this 
test than the controls the difference between the groups was slight 
Indicating the possibility that either subjects already had this 
listening discrimination In their repertoires prior to training or, 
again, that the discrimination was based on voice quality differ- 
ences between different speakers rather than the vowel difference 
between the French and English words. 

In the second part of this study (Final Experiment II) a 
listening discrimination procedvire was progranmed in which the ex- 
perimental subjects were taught to discriminate among words con- 
tal'iing three French nasal vowels and the control subjects only 
listened to the French words as they silently read aloud from a 
list of French words which contained nasal vowels. Subjects* pro- 
nunciations were judged by native French raters on the basis of 
comprehensibility. The mean score of the experimental subjects was 
significantly higher on the pronunciation list, indicating better 
pronunciation, than was the mean score of the control subjects. 
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In neither of these • ? - 3 is it entirely clear what type 

of awiltory stimuli the subjects were discriminating among In 
relation to the actual errors that the subjects made In their 
attenpt to produce the sounds in question. For example, to train 
the subject to discriminate auditorily between correct examples of 
a vocalisation and certain types of Incorrect vocalisations, may 
have little function for the subject *s speech if he never makes 
those particular kinds of errors when speaking. The most relevant 
kind of listening training would appear to be a procedure in which 
subjects are trained to discriminate among correct vocalization and 
incorrect vocalizations of the type that the subject commonly makes 
when he atten^ts to either reproduce or mimic a certain vocalization. 

The purpose of the present pilot study, then, was to investi- 
gate the effects of this kind of listening discrimination upon' 
echoic accuracy. 



PROCEDURE 

Echoic Task 

In order to obtain a sample of sounds which subjects had 
problems in pronouncing, a number of Vietnamese phonemes were re- 
corded by a Vietnao^se speaker. These phonemes were then presented 
to subjects who attempted to mimic them. From this sample, one 
vowel sound ju* j was found which subjects consistently mispronounced 
both when it was presented alone and in combination with other 
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Vietnamese phonemes, A number of recordings were made of the 
vowel by- a Vietnamese speaker with linguistic training, and a 
sample of 30 was selected which were judged by him to be accurate 
productions of the vowel. These 30 W vowels then were re-recorded 
onto a single tape, each separated by two seconds of silent tape. 
Subjects listened to the tape of these 30 o' vowels through ear- 
phones. Their instructions were to listen to these sounds and, in 
the silent interval which followed, to mimic the sound as accurately 
as they could. Subjects heard their own atten 5 >ts at mimicry through 
the earphones. 

Scoring Echoic Responses of Subjects 

There are a number of ways in which vowel sounds may be des- 
cribed: physically, by a spectographlc analysis of the vowel sounds; 

behavlorally, by specification of the behavior (e.g,, tongue posi- 
tion in the oral cavity, amount of roundness of the lips, etc.) 
required to produce the sound; and behavlorally in terms of a 
listener by the construction of rating measures and having native 
speakers of a language rate the intelligibility or correctness of 
the sound produced. For our purposes, the Vietnamese vowel was 
specified in terms of the lip and tongue positions required to pro- 
duce it. For lip position the characteristic of interest was the 
degree of roundness or unroundness of the lips during the subject's 
pronunciations of the u^s. This was judged by the experimenter who 
observed subjects in the experimental situation. For tongue position 
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the characteristic of interest was the relative location 
(front-back, high-low) of the highest arched portion of the 
tongue in the oral cavity. This was judged by a linguist and a 
person with some training in phonetics from the tape recording of 
subjects* performances on the echoic task. 

In general, a correct production of the vowel requires 
(within limits) that the highest airchcd portion of the tongue b© 
in the high back portion of the oral cavity, and the lips be dis- 
tinctly unrounded. As far as tongue position is concerned the 
closest English equivalent is the "oo" sound as in boot, although 
the tongue position for the i/ is slightly higher than for the 
English "oo**. In addition, the **oo" in English is produced with 
the lips rounded, whereas the Vietnamese u^ is produced with the 
lips distinctly unrounded. When subjects were tested on the echoic 
tape four types of errors were noted: 1) lip rounding throughout 

— the subject's vocalization was produced with the tongue in 
roughly the correct position, but the lips were rounded throughout 
the mimicry; 2) tongue position forward and low — the subject's 
vocalization was produced with the tongue position too far forward 
and low, with the lips partially rounded; 3) fairly extreme lip 
rounding at the end of the vocalization; 4) a centralized off-glide 
at the <snd of the vocalization; that is, the tongue position fre- 
quently "glided off" into the central portion of the oral cavity 
with the lips moving to an unrounded position. The types of 
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pronunclatlon errors described above were not mutually exclusive; 
frequently errors (1) and (4), (2) and (4), and (2) and (3) 
occurred together In one vocalization. 

Listening Discrimination Task 

Two types of listening discrimination procedures were used; 

(1) subjects listened to two vocalizations, one following another*, 
and pressed a button Indicating whether these vocalizations were 
either the ’’same*’ or "different"; (2) subjects listened to a single 
vocalization and then pressed the button Indicating whether the 
vocalization was a "correct" or an "Incorrect" example of the 
vowel. Within each of these general types of listening discrimina- 
tion a number of kinds of stimuli were employed which varied for 
each subject. The basic rationale of the listening discrimination 
procedure though was to train subjects to make differential re- 
sponses among stimuli which contained correct and Incorrect charac- 
teristics; further, that the incorrect stimuli be of the general 
t3rpe that the subjects produced when they attenq>ted to mimic the u' 
sound on the echoic task. 

During the listening discrimination procedure subjects listened 
to correct and Incorrect o' stimuli produced by the same person who 
recorded the stimuli for the echoic task. Incorrect stimuli differed 
from correct u^ vowels In the following ways: the highest arched 

portion of the tongue was too far forward and too low (extreme and 
slight versions) ; lip rounding at the end of the vocalization 
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(extreme and slight versions) ; centralized off-gllde at the end 
of the vocalization (extreme and slight versions). 

During each experimental session the subjects first went 
through the echoic task where they atten^ted to mimic the 30 
stimuli. Then they went through the listening discrimination pro- 
cedure which was followed by a repetition of the echoic task. 

RESULTS 

Very early in the listening discrimination it was discovered 
that the subjects entered the experimental situation with a relative- 
ly accurate repertoire of judging the "sameness” of two vocal 
stimuli presented one following another. This was true whether a 
"same" pair of stimuli was the identical stimulus re-recorded 
twice or a pair of two different but correct u^ stimuli. Similarly 
the subjects were highly accurate in recognizing "different" pairs, 
that is, a pair which contained an incorrect iV, no matter what 
type of error the incorrect stimulus contained. Thus for the same- 
different comparison there was little to train the subject to dis- 
criminate. Nevertheless both the subjects continued to mimic the 
ly stimuli incorrectly. The results of the listening discrimination 
procedure when single stimuli were presented and the subjects re- 
quired to judge its correctness or incorrectness were quite different 
from the same-different comparisons. For the correct-incorrect judg- 
ment there was initially a high error rate which decreased gradually 
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over sessions. Concurrently, as subjects became more accurate in 
judging the sounds presented singly their vocal productions In 
some characteristics became more accurate. This relationship will 
be summarised separately for each subject. 

Subject 1 

Subject l*s steady state performance In mimicking the 
stimuli, contained errors of the following type: (1) highest arched 

portion of the tongue too low and too far forward (98 percent of 
trials); (2) centralized off-gllde at the end of the vocaliza- 
tion (27 percent of trials); (3) extreme lip rounding at tha end 
of vocalization (11 percent of trials). 

Tapes containing a number of correct vowels and Incorrect 
vocalizations verc^ made separately for each type of error and for 
the extreme and slight versions of each type of error. Initially, 
Subject 1 was presented with a tape containing the extr^^ime version 
of one type of error. Once he achieved an error rate of less than 
5 percent In judging these stimuli a tape containing the slight 
version of that error was used. After Subject 1 had achieved an 
error rate of less than 5 percent on all tapes with the slight error 
stimuli the stimuli were coinblned so that Subject 1 had to discrim- 
inate between correct exanq;>les of the vowel and three types of 
slight mispronunciations of that vowel which were all contained on 
one tape. 
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Wifchiti the listening diecriminstioa procedure itself there 
were two general characteristic® of Subject l*s perforaance to be 
noted: (1) the discrimination a^aong the correct stimuli and the 

error stimuli where the tongue too low atid forward was isuch 
more difficult than discrimination of the other two types of 
errors; (2) when all three types of errors were included on one 
tape interspersed with correct u* stimuli the accuracy of Subject I’s 
performance in Judging the correctness of each sound Initially 
dropped markedly, even though these were the identical stimuli to 
which the s^ibject had been highly accurate previously when only 
one type of error was Included within each discrimination tape. 

As Subject 1 came under the discriminative control of the 
correct and Incorrect type of stimuli on the listening tapes, two 
changes were noted in the accuracy of his mimicry on the .echoic 
stimuli. First, the percentage of echoic trials on which there was 
a centralised off-gllde at the end of the vocalization dropped from 
approximately 27 percent to approximately 2 percent. Second, the 
percentage of echoic trials on which there was lip rounding at the 
end of the vocalization dropped from 11 percent to less than 1 per- 
cent. Neither of these changes occurred in an abrupt fashion, but 
occurred gradually (and with a considerable amount of variability) 
as listening discrimination progressed. There were no changes noted 
in mimicking accuracy as far as tongue position was concerned. 
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Subject 2 

Subject 2's steady perforaance In mimicking the stimuli 
contained errors of the following types: (1) highest arched por- 

tion of the tongue too low and too far forward (97 percent of 
trials); (2) centralized off-gllde at the end of vocalization 
(18 percent of trials). 

Subject 2 was put through a program of listening discrimina- 
tion (correct-incorrect) similar to that used for Subject 1. 
Initially for Subject 2, listening tapes contalplng only the errors 
of tongue too low and too far forward and centralized off-gllde 
were used. However, because Subject 2 began to exhibit lip round- 
ing errors after the listening discrimination procedures began, 
listening tapes which contained lip rounding error stimuli were 
also included in the discrimination program. 

Subject 2 began on the tape containing correct u^ stimuli and 
each type of error in its extreme form. When she had achieved an 
error rate of 5 percent or lass on these tapes she moved on to the 
tape containing each t3npe of error in its slight form, then onto 
the tape containing all three t}^es of errors in their slight form 
on one tape. 

For the listening discrimination procedure the same two char- 
acteristics were noted in Subject 2*s performance as for Subject 1. 
First, the discrimination among vf stimuli and the stimuli where the 
tongue was too low and too far forward was much moire difficult than 














the discrimination among correct iT stimuli and the other two 
types of error stimuli. Second^ when the listening tape was 
Introduced which contained all three types of error stimuli, an 
initial decrease in accuracy of performance was obtained. 

As Subject 2 came under the discriminative control of the 
correct and incorrect type of stimuli on the listening tape, 
several changes were noted in her echoic accuracy. First, the 
percentage of echoic trials on which ther^ was a centralized off- 
glide dropped from approximately 18 percent to less than one per- 
cent. Concurrently, however, the percentage of the echoic trials 
on which there was lip rounding at the end of the vocalization in- 
creased from zero percent to approximately 12 percent. However, 
once listening tapes containing the lip rounding stimuli were in- 
troduced and mastered, lip rounding errors at the end of vocaliza- 
tions dropped to less than one percent. Again these changes in 
echoic accuracy were gradual and somewhat variable. Further, "ith 
Subject 2 some changes were noted in echoic accuracy with resi/cct 
to tongue position. As listening discrimination progressed Sub- 
ject 2's echoic performances were judged to be produced with the 
tongue further back and higher than previously. However, the tongue 
position did not ever reach a point where the sound produced was 
close enough to the echoic stimulus to be classified as an accept- 
able production. 




FURTHER PROCEDURES 



After all listening discrimination training had been 
completed a procedure of using instructions and differential social 
reinforcement was employed with both subjects in order to deter- 
mine how long it would take 2or subjects to learn to accurately 
mimic the o' vowel. Initially only instructions were employed. 

Each subject was given instructions as to what tongue and lip posi- 
tions were required in order to produce the sound correctly. Further, 
each subject was told that the closest English approximation was the 
”oo” sound as in boot, but produced with the lips distinctly un- 
rounded and were given a demonstration by the experimenter. 

Following this, subjects attempted to mimic the o' stimuli. Although 
their productions were closer to the echoic stimulus than pre- 
viously, the productions were still not within the acceptable 
range. The experimenter then sat with the subjects as they attempted 
to mimic the o' sound. The experimenter supplied differential social 
reinforcement when closer approximations were produced until each 
subject produced an acceptable mimicry of the u^ stimulus. This re- 
quired approximately 20 minutes for Subject 1 and 10 minutes for 
Subject 2. 
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DISCUSSION 

These experiments were not designed to show that training 
the student as a listener was an efficient method of teaching 
pronunciation. The purpose of the experiment was to test the 
by '•hesls that the ability to pronounce the difficult Vietnamese 
phoneme would proceed apace with the subject's skill as a listener. 

With both subjects some changes were produced In their echoic 
accuracy as a result of certain types of listening discrimination 
training, although the extent and kind of. these changes produced 
were quite limited. For both subjects the echoic errors of central- 
ized off-glldes and lip rounding at the end of the vocalizations 
were virtually eliminated. However, tongue position errors were 
not changed for one subject and were only partially Improved for 
the second subject. 

It does not seem likely that the changes produced In subjects' 
echoic accuracy could be accounted for slnq>ly by extended practice 
on the echoic task since prior to the listening discrimination 
training a minimum of 400 trials on the echoic task were given to 
each subject. The performances of both subjects essentially stabi- 
lized after 30 to 50 trials and showed no systematic changes over 
the rest of the 400 trials. In addition, the echoic accuracy of 
the subjects did not Improve until they had concurrently Improved 
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on the listening discrimination tape, although, this relationship 
is difficult to pinpoint exactly because of the large amount of 
variability in the changes in echoic accuracy before stable per- 
formances were achieved. 

Within this study it is not possible to say whether or not 
the changes in the subjects^ echoic accuracy were due to the specific 
type of error stimuli employed on the listening discrimination tape. 
That is, it is not known whether or not it was necessary to have 
subjects make discriminations among correct u^ stimuli and Incorrect 
stimuli of the same type as the errors the subjects commonly made 
when they attempted to mimic correct i/s. It could be that estab- 
lishing a discrimination among other types of Incorrect stimuli 
could have produced a similar result. 

In view of the llmlte. 1 effectiveness of the listening discrim- 
ination training and the amount of time it required (approximately 
70 hours for Subject 1, and approximately 45 hours for Subject 2) 
it is questionable whether this type of listening discrimination 
procedure is currently usable as a practical technique in programmed 
instruction. This conclusion seems even stronger when the relatively 
short period of time is considered which was required to achieve 
an acceptable echoic response through differential social reinforce- 
ment by the experimenter. It Is possible, however, that the effect- 
iveness of the tutorial experience depended in part on the previous 
listening skill which the subject had previously developed. 
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III 

Some Effects of Various Reinforcement Contingencies on Performances 
During a Course In Programmed Vietnamese 

INTRODUCTION 

Techniques of programoed Instruction have been used success- 
fully for a number of years now to produce specified changes In 
the educational behavior of students. As It Is typically employed, 
programmiag relies heavily on the use of ^<tlmulus control and 
fading techniques. M^st often the program begins with material 
which the student can easily master. Gradually new stimulus mater- 
ial Is faded .In at a rate and manner In which students can perform 
with few errors. However, while the stimulus control of the 
student's performance Is often closely specified, the reinforcing 
stimuli which maintain his performance are frequently not explicit. 
Further, although contingencies of reinforcement have been demon- 
strated to exert & powerful Influence upon the behavior of humans 
In a variety of situations, there have been few attempts to mani- 
pulate these contingencies as students go through programmed 
material. That these contingencies can have Important effects Is 
shown by the following example: During a pilot study In which a 

child went through a reading program It was found that the extent 
to which the child's reading behavior was exhibited on various 
tasks was almost entirely a function of the specific reinforcement 
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contlngencles. The Initial task of the child was that of 
matching- to -sample, with the sao^le being words presented audi- 
torily and the choices being words presented textually. At first 
the child was reinforced for choosing the correct textual word. 

When the child achieved a perfect performance for a number of 
words over a number of trials on this task he was given a probe. 

The probe consisted of the presentation of the written words and 
the child was asked to read them aloud. When the reinforcement 
contingencies were attached to performances on the matching- to - 
sample task the child typically acquired an errorless performance 
on it, but did not exhibit any acceptable behavior during the probe. 
However, when reinforcement was made contingent upon probe behavior 
and the opportunity to engage in the probe contingent upon a per- 
fect matching- to -sample performance both acceptable matchlng-to- 
sanple performances and probe performances were developed. 

The purpose of this study was to investigate this type of phe- 
nomenon in a more systematic manner with adults as they went 
through a programmed course in Vietnamese, The Vietnamese course 
consisted of 20 sections. Each section had two parts: a programmed 

section and a probe. The first part was a programmed series of 
cards in which textual and pictorial and auditory stimuli were pre- 
sented to subjects. On the basis of these stimuli subjects chose 
among several textual alternatives. The second part of each section, 
the probe, was a series of stimuli again textual, pictorial, and 



auditory to which the subjects were to respond vocally. The 
probe was administered by a monitor who followed a standard pro- 
tocol. The monitor was Instructed only to present the various 
stimuli to subjects and to record their response, and not to 
Interact with them in any other way. Thus, during the first 
part of each section subjects chose among textual alternatives, 
while during the second part they made vocal responses In Vietnamese. 

Experiment 1 

The first experiment which was performed was to evaluate the 
effects of money reinforcement presented contingent upon subjects' 
probe performances as against being presented upon an hourly basis 
for attendance. Further it was decided to use each subject as 
nls own control by alternating blocks of sections under each 
procedure . 

PROCEDURE 

For the probe contingency pajnment condition the following 
procedures were in effect; (1) subjects could go through the pro- 
grammed instruction part of each section at their own rate; 

(2) the programmed part of each section would be followed by the 
probe; (3) a lump sum of money would be paid each subject when 
the probe was passed. (Criteria of passage of each probe was de- 
cided on in advance by the experimenters. In general, to pass a 
probe the subject had to vocally exhibit at least once all of the 
new Vietnamese which he had previously dealt with textually in the 
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programned part of the section. This was a relatively strict 
criterion for passage, since the subject had to use the new Viet- 
namese material both in descriptive tasks and in response to 
Vietnamese questions. Any single failure of a subject to vocally 
emit the proper Vietnamese words or phrases was considered a 
failure.) (4) a subject who failed to pass the probe was required 
to go back to the progranmed material and go through as much of it 
as he felt necessary in order to pass the probe, at which time the 
probe could be retaken. 

For the hourly payment condition procedures (1) and (2) given 
above were in effect. In the hourly payment condition, however, 
money payment was made simply on the basis of amount of time a sub- 
ject spent coiopletlng the programmed material and the probe. Under 
the hourly payment condition one additional procedure was in effect. 
Following each probe subjects who failed to achieve a performance 
equal to a pass were tutored individually until they could achieve 
this perfonssnce . This was felt to be necessary because of the 
cumulative nature of the programmed sections. In other words, the 
material was so constructed that a correct performance on early 
sections on the program material was necessary in order for a 
correct performance on later sections. Since subjects in the probe 
contingent payment condition had to pass the probe before receiving 
payment and thus going on to the next section, to make the two 
conditions equivalent at each step except for the reinforcement 













contingencies, subjects in the hourly condition were tutored if 
they did not exhibit a performance on the probe which was equiva- 
lent to a pass. The tutoring was done in a matter of fact manner 
and pains were taken to avoid any implication of a failure. 

For both conditions subjects received their money payment im- 
mediately following each session. The lump f5ums which were paid 
under the probe contingent condition were set by the experimenter 
so that if a subject went through the programmed material at a nor- 
mal rate and passed the probe the first time, he would receive an 
amount slightly in excess of what he would have received on an 
hourly basis. If the subject went through the progratmoed material 
at a normal rate, failed the probe, and had to return to the 
programo^d material a second time before passing the: probe, he 
would receive an amount less than what he would have received if he 
had been on the hourly basis. 

The primary dependent variable of Interest in this study was 
the proportion of passing scores on the probe the first time it was 
taken. However, other measures of subjects' performances, such as 
proportion of correct and Incorrect responses and time spent per 
card on the programmed material, were taken. 

Four subjects were used in this study. All four were students 
who were used during their summer vacations. Two subjects were 
college students, one a freshman and one a sophomore. The other 
two subjects were junior high students. Typically, subjects were 
run three times a week taking one section of the program each time, 
although this varied slightly because of time conflicts. 






The sequencing of conditions and sections of the program 



is given for each subject in Table 1. 



Insert Table 1 about here. 



RESULTS 

The number of probes passed for all four liubjects, individually 
and as a group. Is glven-ln Table II. 



Insert Table II about here. 



As can be seen from the totals there was a slightly greater overall 

number of probes passed under the probe contingent payment condl- 

/ 

tlon than under the hourly payment condition. However, this dif- 
ference was slight and there were no clear-cut effects of the two 
pay conditions on number of probes passed within each subject. 

No systematic data were obtained relating the reinforcement 
conditions to the number of correct and Incorrect responses or time 
spent on each card during the program material parts of each section. 

DISCUSSION 

A close examination of subjects' performances on each section 
and a re-evaluation of the reinforcement procedures enq>loyed re- 
vealed the following problem areas: (1) all sections of the program 















TABLE 1 



Sequence of re Infor cement conditions and sections for each subject 



Reinforcement conditions 



Subjects hourly payment probe contingent payment 



SI (college soph.) 

S3 (jr. high student) 


1 

) 

Sections 

6-10, 16-20 


1 

Sections 

1-5, 11-15 


S2 (college fresh.) 

S4 (jr. high student) 


Sections 

1-5, 11-15 


Sections 

6-10, 16-20 

1 



TABLE 2 



Number of probes passed and failed for each subject under the two 
reinforcement conditions 



probe payment 
contingency 



hourly pa 3 mient 



Probes passed Probes failed 





» 

SI 


S2 




S3 




1 

SI 


S2 


S3 


S4 




9 


5 




6 


9 


1 


5 


4 


1 




Total : 


29 






Total : 


11 






SI 


S2 




S3 


S4 


SI 


S2 


S3 


S4 




8 


3 




8 


4 


2 


7 


2 


6 


1 

} 

( 


Total : 


23 




t 

1 


Total: 


17 
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did not appear to be equally difficult. In particular, sections 
6 through 10 appeared to be considerably easier than the remaining 
15 sections. This unequal difficulty made it difficult to properly 
evaluate the effects of various reinforcement contingencies, especially 
considering the limited number of sections available for experimenta- 
tion; (2) the dlchotomlsatlon of the probe performances into 
either passing or falling with strict criteria for passing did not 
seem to be a sensitive enough measure of the effects of the rein- 
forcement contingencies; (3) the procedure of tutoring the subjects 
under the hourly payment condition when they did not exhibit a probe 
performance equivalent to a pass may have had instructional effects 
which were similar to the effects of the probe contingent payment 
condition* 

Ihese problem areas suggested both revisions in the Vietnamese 
program and further experimentation. For the Vietnamese program 
the following changes were made: (1) sections 6 through 10 were 

revised so that they were approxlsaately equal in difficulty. This 
was done by both combining several sections and introducing new 
material; (2) scoring of the probes was revised so that a subject's 
performance could be graded on a continuum of accuracy and coiq>lete- 
ness. In addition, several new sections were added to each probe 
in order to test the limits of the subject's Vietnamese repertoire. 
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Experiment II 

The second experiment was done with the revised Vietnamese 
program which now consisted of 17 sections. As before, each 
section consisted of two parts, the section of programmed material 
and a probe section. In addition, the scoring system for ftach probe 
was designed such that an acceptable vocal response to each problem 
or situation presented on the probe received a point score. An 
acceptable vocal response differed from probe to probe and from 
problem to problem on the probe. In some cases an acceptable re- 
sponse could be one Vietnamese word. In other cases a sentence or 
two In Vietnamese might be required. However, because the subjects' 
Vietnamese repertoire could be predicted by the programmed material 
they had already completed. It was possible to specify In advance 
what the range of possible correct answers would be for each part 
of the probe. 

Since the probes were composed of a number of discrete p<rob- 
lems or situations It was then possible to assign a maximum possible 
score which could be obtained for each probe. In addition, the 
probe was arranged so that subjects did not Interact with another 
person while they were taking the probe. A series of cards with 
pictures and Instructions on them plus a tape recorder to present 
auditory stimuli provided all the stimulus material subjects required 
to go through the probe. Subjects' vocal responses during the probe 
were recorded and scored .Immediately afterward. 
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The purpose of Experiment II was to evaluate the effects of money 
reinforcement presented contingent upon subjects* accuracy during 
the programmed material and during the probe, as against money pre- 
sented contingent only upon completion of the programmed material 
and the probe. Again, each subject used his own control by alter- 
nating blocks of sections under several reinforcement conditions. 

PROCEDURE 

Initially all subjects were run under conditions of payments 
simply for con^letlon of both parts of each section. This was done 
In order to establish a rough baseline of accuracy of performance 
for each subject. Before starting subjects were given Instructions 
to perform as accurately as possible on both parts of each section. 
When they had completed both parts of each section they were given 
a fixed sum of $2.50. Under these conditions the amount of time 
taken to con^lete each section varied considerably among subjects 
and sections, with the mean being about 65 minutes for each section 
and the range being approximately 40 minutes to 2 hours and 10 minutes. 

During the procedure In which money was presented contingent 
upon subjects’ accuracy there were two possible general conditions 
(or a combination of the two): (1) as the subject went through the 

program material every five correct first responses to the cards re- 
sulted in the addition of a point on a counter visible to the sub- 
ject. Following the session each point was converted into money 
and given to the subject. Because each subject had a different 
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baseline of acctiracy on the progranmad material, the worth of 
each point varied among subjects. However, once this amount was 
established for each subject it was kept constant for that subject. 
T 3 T>ically, the worth of each point was either 5 cents or 10 cents. 

The worth of each point on the counter was announced to subjects 
in advance of the session; (2) the subjects were given a payment 
according to the score they had obtained on the probe . There were 
two different variations of this procedure which were used: (a) a 

fixed sum of money was set; if the subject obtained the maximum 
number of points obtainable, he received all the money. If the sub- 
ject did not obtain the maximum number of points obtainable, he re- 
ceived a sum proportional to the proportion of total points obtained. 
This procedure was used in the cases of four subjects who had a 
baseline of performance on the probe where they typically obtained 
less than 1/2 of the total points available. Further, becuase of 
baseline differences in accuracy the fixed sum of money for each 
subject on the probe varied among subjects but remained constant 
for each particular subject. Typically the amount was between $3.00 
and $5.00; (b) for three subjects who had a baseline of performing 

relatively accurately on the probe (tjrplcally obtaining in excess 
of 50% of the total points possible) a slightly different procedure 
was used. Since these subjects were already relatively accurate 
on the probe it seemed essential to provide a condition under which 
small Improvements In accuracy would result in relatively large pay- 
offs. For these subjects a point category pay basis was established 








- 33 - 





such that if their accuracy continued at their normal level 
they would receive a nominal amount of money (approximately 
equal to the amount they would have received for the time spent 
if they had been on the simple completion payment condition). 
However, if subjects perfoimied more accurately than previously 
the amount of pay received increased step-wise in a roughly geo- 
metric fashion to a fixed limit. Thus, proportionally small in- 
creases in accuracy resulted in relatively large Increases in 
amount of pay received. 

The subjects were seven women who had answered a newspaper 
advertisement requesting subjects for language experiment. All 
were housewives with varying amounts of previous training in for 
elgn languages. Hone had any prior experience with Vletnao^ise. 

The sequencing of reinforcement conditions for the sections 
of the program for each subject is given in Table III. 



Insert Table III about here. 



The primary dependent variables of interest in this study 
were the number of correct first responses emitted during the 
programmed material and the proportion of total possible points 
obtained on the probes. 




TABLE 3 



Reinforcement conditions for each subject by sections 





1 


pay for accuracy i 


pay for pr.' ortion 


differential pay : 




1 pay for completion 


on programmed | 


OiC w. s.^jt ^OxTitS 


points on probe 


Subject 


of each section 


material ' 


c r. " 0 


iabQve- baseline 



SI ^ Sections 1-3 

: 9-12 

i 

1 

i 

1 


i 

Sections 4-8 

13-17 


1 

Sections 4-3 ! 

I 13-17 1 

1 ! 

1 i 


€ i 

*' S2 ! Sections 1-4 

! 9-12 

( 

1 

1 

f 


Sections 5-8 


Sections 5-8 

13-17 


1 

1 

i 

1 

1 

1 

1 

1 


S3 


1 

I 

1 

1 Sections 1-3 

! 9-13 

* 


Sections 4-8 

14-17 

1 i 


Sections 4-8 

14-17 


] 

\ 

1 

1 

i 

1 

1 


S4 

i 

i 

__ __ « 


Sections 1-4 
9-13 

i 

i 

1 


Sections 5-8 


-r -r ' 

i 

1 


' Sections 5-8 
; 14-17 


^ 1 
1 

S5 Sections 1-8 

( 

4 

\ 

\ 

I 


Sections 9-17 


" y — 

Sections 9-17 — — — 


4 

1 

So j 


Sections 1-8 


Sections 9-17 


i 

1 

1 Sections 9-17 


S7 

« ! 


Sections 1-9 

i 

1 




1 

i 


Sections 10-17 
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RESULTS 

The data obtained for correct first responses during the 
programmed Instruction part of the sections yielded no consistent 
overall differences between the condition In which points were con- 
tingent upon accuracy and the condition In which subjects were paid 
merely f6r conpletlng the.. section. 

The data obtained from the probe 4 >ortlon of each section, 
however, were different under conditions of contingent pay for 
accuracy as against pay for conq>letlon of the section. For six of 
the seven subjects the mean proportion of total points obtained on 
the probe was higher under the contingent pay condition than under 
the completion pay condition. A graph of the proportion of total 
points obtained under each condition for all seven subjects Is pre- 
sented In Figures 1, 2, 3 and 4. 

Insert Figures 1, 2, 3 and 4 about here. 



DISCUSSION 

The failure to obtain differences In accuracy of performance 
during the programmed Instruction part of each section, perhaps, 
should not be too surprising. Prior to the present experiment this 
part of the Vietnamese course had been subjected to a fairly exten- 
sive program of testing and revision. Several groups of subjects 
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had been put through the program. After each group had been 
tested revisions were made, with the object of reducing the 
number of errors subjects emitted. The consequent reduction in 
error rate then may have contributed to the lack of sensitivity 
in reflecting the possible differential effects of money presented 
contingent upon accuracy as against money presented contingent 
upon conq>letion of each section. 

The data from the probe portion of each section appears 
relatively clear: for six of the seven subjects the presentation 

of money contingent upon accuracy and conq>leteness produced markedly 
more accurate and complete performances on the probes than did the 
presentation of money contingent only upon finishing the probe. 

In addition, for subjects 1, 2, 3 and 4 there was an additional 
common characteristic of their performances on the probe to be noted. 
The first application of the accuracy contingent payment condition 
appeared to produce a marked effect. When these subjects were re- 
turned to the conditions of merely finishing the probe for payment 
their performances did not return to their previous rate of accuracy 
but remained higher. However when accuracy contingent pay was re- 
sumed accuracy on the probes rose even higher. 

The results of Experiment II suggest that, for subjects with 
a normal English repertoire, substantial gains in vocal behavior in 
a second language may be obtained by application of reinforcement 

for engaging in this behavior. It should be noted that although 
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money reinforcement was differential in the sense that greater 
vocal output and accuracy resulted in greater monetary pay, no 
attenq>t was made to "shape" subjects* vocalizations. Whatever 
accuracy they developed was entirely a product of their interaction 
with the programmed material. 
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